A neural architecture search based framework for liquid state machine design

نویسندگان

چکیده

Liquid state machines (LSMs), also known as the recurrent version of spiking neural networks, have garnered significant research interest owing to their high computational power, biological plausibility, simple structure, and low training complexity. By exploring design space in network architectures parameters, recent works demonstrated great potential for improving accuracy LSM models with However, these are based on manually defined or predefined which may ignore optimization parameters LSMs. In this study, we propose a architecture search-based framework explore parameter automatic dataset-oriented models. To manage exponentially increasing space, adopt three-step search LSMs, including dynamic multiple-liquid multiple layers, variations number neurons each liquid, such percentage connectivity excitatory neuron ratio within liquid. addition, use simulated annealing algorithm implement heuristic search. Two datasets, image dataset NMNIST speech FSDD, were used test effectiveness proposed framework. Simulation results that our can produce optimal The best classification two datasets only 1000 was observed be 92.5% 84%. Meanwhile, connections discovered average, reduced by 56.3% 60.2% separately compared single LSM. Furthermore, total 20% an loss 0.5%.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Codification conceptual framework of education for students in architecture Primary design studios: A qualitative content analysis

Coordination of education categories and activities of novice students in architectural primary design studios is indispensable and can lead to the designing ability development and transition towards professionalism and proficiency. The objective is a conceptual framework for architectural education based on the categories of architectural education and novice studentschr('39') activities in a...

متن کامل

Liquid State Machine Optimization

In this thesis several possibilities are investigated for improving the performance of Liquid State Machines. A Liquid State Machine is a relatively new system that is a Machine Learning system, which is capable of coping with temporal dependencies. Basic Recurrent Neural Networks often have problems with this. One reason for this is that it takes a long time to train the Recurrent Neural Netwo...

متن کامل

Location-based services: A framework for an architecture design

Location awareness describes applications in computing and telecommunications, which alter their behaviour in dependence on the location of an entity, such as the user of an application, a person the user of the application wants to communicate with, or an object capable of changing a location. Such location presents a major category of context and it is derived by various methods of positionin...

متن کامل

PREDICTION OF SLOPE STABILITY STATE FOR CIRCULAR FAILURE: A HYBRID SUPPORT VECTOR MACHINE WITH HARMONY SEARCH ALGORITHM

The slope stability analysis is routinely performed by engineers to estimate the stability of river training works, road embankments, embankment dams, excavations and retaining walls. This paper presents a new approach to build a model for the prediction of slope stability state. The support vector machine (SVM) is a new machine learning method based on statistical learning theory, which can so...

متن کامل

A Differential Evolution and Spatial Distribution based Local Search for Training Fuzzy Wavelet Neural Network

Abstract   Many parameter-tuning algorithms have been proposed for training Fuzzy Wavelet Neural Networks (FWNNs). Absence of appropriate structure, convergence to local optima and low speed in learning algorithms are deficiencies of FWNNs in previous studies. In this paper, a Memetic Algorithm (MA) is introduced to train FWNN for addressing aforementioned learning lacks. Differential Evolution...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2021

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2021.02.076